HERMITE NORMAL FORMS AND 8- VECTOR 



TAKAYUKI HIBI, AKIHIRO HIGASHITANI AND NAN LI 

Abstract. Let 8(V) = (8q, Si, . . . ,8 a) be the <5-vector of an integral polytope 
V C M. N of dimension d. Following the previous work of characterizing the 8- 
vectors with J2i=o ^ — ^> ^ ne P 0SS1 ble 8- vectors with J2i=o ^ = ^ wm ^ e classified. 
And each possible <5-vectors can be obtained by simplices. We get this result by 
studying the problem of classifying the possible integral simplices with a given 
5-vector (Sq, Si, ... , Sd), where 2j=n ^* — ^> by means of Hermite normal forms of 
square matrices. 



1. INTRODUCTION 

1.1. Background for 5- vectors. Let V C M. N be an integral polytope of dimension 
d and dV its boundary. Define the numerical functions i(V, n) and i*(V, n) by setting 

i(V,n) = \nVnZ N \, i*(P,n) = \n(V - dV) n Z N \. 

Here nV = {na : a G V} and |X| is the cardinality of a finite set X. The systematic 
study of i(V, n) and «*(P, n) originated in Ehrhart pQ around 1955, who established 
the following fundamental properties: 

(0.1) i(V, n) is a polynomial in n of degree d; 
(0.2) z(P,0) = l; 

(0.3) (reciprocity law) i*(V,n) = (—l) d i(V, —n) for every integer n > 0. 

We say that i(V,n) is the Ehrhart polynomial of "P. An introduction to Ehrhart 
polynomials is discussed in [HI pp. 235-241] and [21 Part II]. 
We define the sequence So, Si, 62, ■ ■ ■ of integers by the formula 

(00 \ 00 

l + £)i(P,n)A») = j>A*. 
re=l ' i=0 

In particular, S — 1 and <5i = D Z^l — (d + 1)- Thus, if 5i = 0, then P is 
a simplex. The above facts (0.1) and (0.2) together with a well-known result on 
generating function ([HI Corollary 4.3.1]) guarantee that 5i = for every i > d. We 
say that the sequence 

5(V) = (6 ,5 1 ,...,S d ) 
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which appears in Eq. (CQ) is the 5-vector of V and the polynomial 

S v (t) = S + S 1 t + --- + S d t d 

which also appears in Eq. ([T]) is the 5-polynomial of V. 
It follows from the reciprocity law (0.3) that 

(oo \ d 

n=l ' i=0 

In particular, S d = \{V — dV) fl Z N \. Each Si is nonnegative ([9]). If Sd ^ 0, then 
S\ < Si for every 1 < i < d ([3]). 

Let s = max{ i : Si ^ }. Stanley [TO] shows that 

(2) S + S ± + • • • + Si < S s + 5 s _i + • • ■ + S s _ u 0<t< [s/2\ 
by using Cohen-Macaulay rings. The inequalities 

(3) S d _ 1 + S d - 2 + --- + S d _ i <S 2 + S 3 + --- + S i + S i+1 , l<i< L(d-1)/2J 
appear in [21 Remark (1.4)]. 

1.2. Main result: characterization of 5-vectors with Ylt=o $i = 4- One of the 

most fundamental problems of enumerative combinatorics is to find a combinatorial 
characterization of all vectors that can be realized as the 5-vector of some integral 
polytope. For example, restrictions like So — 1, Si > 0, (j2J) and (j3J) are necessary 
conditions for a vector to be a 5-vector of some integral polytope. 

On the one hand, the complete classification of the 5-vectors for dimension 2 is 
given essentially by Scott [7] , while the case where the dimension is greater than or 
equal to 3 is presumably unknown. In [4J , on the other hand, the possible S- vectors 
with J2i=o^i — ^ are completely classified by the inequalities (j2J) and (J3J). 

Theorem 1.1. [U Theorem 0.1] Let d > 3. Given a sequence (So, Si, . . . , S d ) of 

nonnegative integers, where So — 1 and Si > S d , which satisfies Ylt=o ^* — ^ there 
exists an integral polytope V C M. d of dimension d whose S-vector coinsides with 
(S , Si, ... , S d ) if and only if (S , Si, ... , S d ) satisfies all inequalities (|2]) and ([3]). 

However, this is not true for X/»=o^* = ^ (PQ Example 1.2]). In this paper, we 
will give the complete classification of the possible S- vectors with J2i=o ^ = 4 ( see 
Theorem 15. ip . Moreover, similarly to ^ i=0 $i < 3, it turns out that all the possible 
(5-vectors with ^2 i=0 Si = 4 can be chosen to be integral simplices, although this does 
not hold when ^2 i=0 Si = 5 (Remark 15. 3p . 

2 



1.3. Approach: a classification of integral simplices with a given 5- vector. 

Let Z dxd denote the set of d x d integral matrices. Recall that a matrix A G Z dxd is 
unimodular if det(A) = ±1. Given integral polytopes V and Q in M. d of dimension 
d, we say that V and Q are unimodularly equivalent if there exists a unimodular 
matrix U G Z dxd and an integral vector w, such that Q = fu(V) + w, where fu 
is the linear transformation in M. d defined by U, i.e., /[/(v) = v£7 for all v G M. d . 
Clearly, if V and Q are unimodularly equivalent, then 8(V) = 8(Q). Conversely, 
given a vector v G Z^q 1 , it is natural to ask what are all the integral polytopes V 
under unimodular equivalence, such that 8(V) = v. 

In this paper, we will focus on this problem for simplices with one vertex at the 
origin. In addition, we do not allow any shifts in the equivalence, i.e., <i-dimensional 
integral polytopes V and Q are equivalent if there exists a unimodular matrix U, 
such that Q = fuiP)- By considering the 5- vectors of all the integral simplices up 
to this equivalence whose normalized volumes are 4, we will get our main result 
Theorem 15.11 

For discussing the representative under equivalence of the integral simplices with 
one vertex at the origin, we consider Hermite normal forms. 

Let V be an integral simplex in M. d of dimension d with the vertices 0, Vi, . . . , v^. 
Define M(V) G Z dxd to be the matrix with the row vectors v 1; . . . , v^. Then we 
have the following connection between the matrix M(V) and the 5-vector of V: 
\det(M(V))\ = ^j> <5i- In this setting, V and V are equivalent if and only if 
M(V) and M{V') have the same Hermite normal form, where the Hermite normal 
form of a nonsingular integral square matrix B is the unique nonnegative lower 
triangular matrix A = (ay) G Z>Q d such that A = BU for some unimodular matrix 
U G Z dxd and < < an for all 1 < j < i, (see Chapter 4]). In other words, 
we can pick the Hermite normal form as the representative in each equivalence class 
and study the following 

Problem 1.2. Given a vector v G Z^ 1 , classify all possible dxd matrices A G Z dxd 
which are in Hermite normal form with S(V) = (8q, 8\, . . . , 8^) = v , where V C M. d is 
the integral simplex whose vertices are the row vectors of A together with the origin 
in R d . 

1.4. Structure of this paper. In Section 2, the way we approach Problem 11.21 
will be described. Concretely, we develop an algorithm for any Hermite normal 
form A to compute its 5-vector. (See Theorem 12.11 ) This actually gives a new way 
to compute the 8- vector for any integral simplex via its Hermite normal form. This 
algorithm can be very efficient for simplices with small volumes and prime volumes. 

Based on this algorithm, as a by-product, we can derive some conditions for 
Hermite normal forms to have "shifted symmetric" 5-vector, namely, 8i = 8d+i-i for 
1 < % < d. We will discuss these conditions for two classes of Hermite normal forms 
in Section 3. 
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In Section 4, we apply Theorem 12.11 and obtain a solution to Problem 11.21 when 
J2i=o 8% < 4. Section 4.1 is devoted to studying the case Ylt=o ^ = 2, Section 4.2 is 
Ylt=o ^ = 3 and Section 4.3 is Y^t=o $i = 4- 

Finally, in section 5, as our main result, we show that the inequalities ([2]) and (J3]) 
with an additional condition will give all possible 5- vectors with J2i=o ^ = 4- And 
in this case, all S- vectors can be obtained by simplices (Theorem 15. ip . 

Acknowledgements. We thank Richard Stanley for useful discussions and Steven 
Sam for carefully reading the previous draft of this article. We also thank the 
reviewers for their very helpful suggestion. 

2. An algorithm for the computation of the 5- vector of a simplex 

In this section, we introduce an algorithm for calculating the 5-vector of integral 
simplices arising from Hermite normal forms. 

Let M G Z dxd . We write V(M) for the integral simplex whose vertices are the 
row vectors of M together with the origin in M d . We will present an algorithm to 
compute the 8- vector of V(M). To make the notation clear, we assume d = 3. The 
general case is completely analogous. Let A be the Hermite normal form of M. We 
have that {V{M) n Z d } is in bijection with {V(A) H Z d }. By definition, 

/an \ 
A = I a 2 i a 22 , 
\a 3 i a 32 a 33 / 

where each is a nonnegative integer. 
For a vector A = (Ai, A2, A3), consider 

6(A) := (Ai, A 2 , A 3 )A = (anAi + a 2 iA 2 + a 3 iA 3 , a 22 A 2 + a 32 A 3 , a 33 A 3 ). 

Then it is clear that the set of interior points inside V(A) ((V(A) — dV(A)) HZ 3 ) is 
in bijection with the set 

{(Ai, A 2 , A 3 ) I Aj > 0, Ai + A 2 + A 3 < 1, b{\) e Z 3 }. 

An observation is that n(V(A) — dV(A)) (1 Z 3 , for any n G N, is in bijection with 

{(Ai, A 2 , A 3 ) I Ai > 0, Ai + A 2 + A 3 < n, 6(A) e Z 3 }. 

We first consider all positive vectors A satisfying 6(A) G Z 3 . By the lower trian- 
gularity of the Hermite normal form, we can start from the last coefficient of 6(A) 
and move forward. It is not hard to see that each vector A should have the following 
form: ({r} is the fractional part of a rational number r.) 

A3 = Af 3 := — + h, 

%3 

A 2 = A? M := 3 - {Q32A " } + k 2 , 

0-22 
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and 

^ _ yijkM ._ i - { Q 2lA^ + 031-^3} ^ 

1 an 

for some nonnegative integers £3, &2, fci, where fc G {1, 2, ... , 033}, j G {1,2,..., 022}, 
% G {1, 2, . . . , a n } and Af = A?'*' , A J 2 fc = Af '°, A* = A*' . We call all the vectors A 
with the same index k) the congruence class of k). 

Now we go to the condition Ai + A 2 + A 3 < n in the above bijection. As n increases, 
we ask when is the first time that a congruence class (i, j, k) starts to produce interior 
points inside nV(A). In other words, fix k). We want the smallest n such that 
Ai + A 2 + A 3 < n with Ai, A 2 , A 3 > 0. Then it is clear that this happens when 
k\ = k 2 = k 3 = and 

n = s ijk := LAf + Af + A 3 fe J + 1, 

where [r\ for a rational number is the biggest integer not larger than r. 

Finally, when n grows larger than s^, we want to consider how many interior 
points this fixed congruence class produces. Let n = s^k + £, so each interior point 
corresponds to a choice of k\ > 0, k 2 > 0, k 3 > in the formula of X l f k,kl , X£ ,k2 and 

A^ 3 such that k x + k 2 + h < L There are (^ d ^ 1 )^j = { d+ /) choices in total. 

To sum up, we have the following two observations for each congruence class 
(i,j,k), k G {1,2, . . . ,a 33 }, j G {1,2,..., 022}, i G {1, 2, . . . , an}: 

(1) s^k is the smallest n such that this congruence class contributes interior 
points in the n-th dilation of V(A); 

(2) In the (sy fc +£)-th dilation of V(A), this congruence class contributes 
interior points. 

Therefore, the following Theorem holds. We state it for a general dimension d, 
and the proof is analogous to the case d = 3. 

Theorem 2.1. Let V(A) be a d- dimensional simplex corresponding to a dxd matrix 
A = (a^) G Z dxd . Then the generating function for the interior points of nP(A), 
i*(V(A),n) = \n(V(A) - &P{A)) nZ d \ is 

00 

^2i*(V(A),n)t n = (l-t)- ((m) tSn '"* d > 

n=l (h,---,id) 



where 



with 



s h—i d 



L fe=l 



+ 1, 



O-dd 
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and for each 1 < k < d, 

, i k ,ik+u-id _ -1 (■ J 

\ ^ /i=fc+l 

i?y t/ie reciprocity law (0.3), we have 

h { A){t)= y, /''•' •-••-<. 

(*l,---,*d) 

Example 2.2. Let A be the 4x4 matrix 

/l 0\ 

10 

112 0' 
\1 1 3/ 

Consider 

6(A) = (Ai, A 2 , A 3 , \a)A = (Ai + A 3 + A 4 , A 2 + A 3 , 2A 3 + A 4 , 3A 4 ). 

Denote 

Ai = |, forj = 1,2,3, A 3 J = ^^, fori = 1,2, 
A^ = 1-{A 3 J }, A? = 1-{A? + AJ} 

and 

1 • .A;' • • A 3 j • \{\. 

Then we have 

Sn = 2, S21 = 3, s 12 = 2, S22 = 3, Si 3 = 3, S23 = 5, 
3 2 

5p (A) (t) = ^ J2 td+1 ~ Sl3 = 1 + 3t 2 + 2t 3 , 
i=i j=i 

and thus 

5(P(A)) = (1,0,3,2,0). 

3. Shifted symmetric ^-vectors 

In this section, we define shifted symmetric S- vectors and study its conditions for 
some special Hermite normal forms. Results in this section are direct applications 
of the algorithm developed in the previous section (Theorem 12. ip . In [5J, the second 
author studied shifted symmetric S- vectors without using the algorithm. 

We call a ^-vector shifted symmetric, if Si = Sd+i-i, 1 < i < d. For example, 
(1, 1, 2, 2, 1, 2, 2, 1) is shifted symmetric. 

We want this definition because it simply arises from the algorithm for the "one 

row" Hermite normal forms as discussed in the first subsection. In the second 
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subsection, we will consider a special "one row" Hermite normal form, which allows 
us to have better results. 

3.1. "One row" Hermite normal forms. Consider all d x d matrices with de- 
terminant D and the following Hermite normal forms for some k £ {1,2, . . . ,d}. 



(1 



\ 



(4) 



.4 



D 



a i 



1 

a k-i 



D 



\ 



V 



where a\, . . . , ak-i are nonnegative integers smaller than D and all other terms are 
zero. Let dj denote the number of j's among these a/s, for j = 1, . . . , D — 1. Then 
we can simplify Theorem 12.11 for these "one row" Hermite normal forms. 

Corollary 3.1. Let M e Z dxd with det(M) = D and V(M) be the corresponding 
integral simplex. If its Hermite normal form is of the form as in (J3J), then we have 



D 



JT{M) 



d+l—Si 



i=l 



where 
(5) 



3=1 



+ d. 



Proof. Consider 

6(A) = (Ai, . . . , Afc, . . . , Xd)^D = (Ai + a%Xk, ■ ■ ■ , Xk-i + Uk-i^k, DX k , Xk+i, 



A d ). 



Using notation from the proof of Theorem 12 .![ we have, for i = 1,2, . . . , D, 



X\ 



D' 1 



XI 



D 



, for 



k-1 



and 



A k+1 



Therefore, s< = 1 + [X[ + ■ ■ ■ + A^J 



i 

D 



D-l I vj 



D 



+ d. 



□ 



Now we are going to deduce a symmetry property of the 5-vectors by using this 
Corollary. 
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Proposition 3.2 (Shifted symmetry for "one row"). For a matrix M e Z dxd with 
Hermite normal form (j3J), we have Sj + sd-% = d + 1, for i — 1, . . . ,D — 1, which 
implies Si = Sd+i-i by reciprocity, if and only if the following three conditions hold: 



(1) J2f=i jdj — 1 is coprime with D; 

(2) dj = for all j which is not coprime with D; 

(3) E£rM = d-l. 

Proof. Let us consider Sj + s_D_j. For an integer a, let a denote the residue class in 
Z/DZ. Then we have 



D-i 
D 



E 



+ 2d 



+ 



g - » - T,f=i (g - 



+ 2d. 



Since 



(6) 



* ~ Ef=i 1 U'dj = i ^1 - Ef=i X 3 d jj (mod D), 

- i ~ Ef=i (D - t)jd j = {D-i)(l- Efji 1 jd^ (mod D) 
if the condition (1) is not satisfied, then one has 



Si + s D . 



D 



+ 2d 



D-l — 



2d+l~Y^ 



3=1 

D-l 



ij + (D ~ i)j 
D 



(1; 



>2d+l-J2 d j>d + 2>d+l 

3=1 

for some % with 1 < % < D — 1. Thus, the condition (1) is a necessary condition to 
be Si + Sr>-i = d + 1 for all i. On the contrary, when the condition (1) is satisfied, 
again from (JBJ), we have 



D-J2?- 1 1 [ij+(D-i)j)d 



Si + s D ~ 



D 



2d -I 



D-l — 



2d-Y\ ij + {D ~ i)i d i 



3=1 

2d- e 



D does not divide ij 



If the condition (2) is not satisfied, then we have 



Si + SD-i = 2d — dj > d + 1 

D does not divide ij 

for some % with 1 < % < D — 1. Hence, the condition (2) is also a necessary condition. 
In addition, if the condition (3) is not satisfied, then we have Sj + so-i > d + 1. 
Thus, the condition (3) is also a necessary condition. On the other hand, when the 
conditions (1), (2) and (3) are all satisfied, we have Sj + sd-% — D + 1 for all i. 
Therefore, we obtain a necessary and sufficient to be Sj + s^^i — d + 1 for all i. 

□ 

The conditions of Proposition 13.21 are not very easy to check, so we consider a 
special case of Hermite normal forms (jlj) . 

3.2. "All D - 1 one row" Hermite normal forms. Assume in addition du—i — 
d — 1 in Corollary 13. 1[ i.e., the Hermite normal form looks like 

/ 1 \ 



(7) 



Then we have 



1 



\D - 1 D - 1 



D — 1 Dj 



Corollary 3.3 (All D — 1). For a matrix M 6 r L dxd with Hermite normal form ([7]) ; 
we have 

D 



h{M){t) = J2 td+1 S% where Si 



i=l 



id 
D 



+ 1. 



For the Hermite normal form (J7J), the conditions for shifted symmetry in Propo- 
sition 13.21 can be simplified. 

Proposition 3.4 (Shifted symmetry for "all D — 1 one row"). Let M e 7j dxd with 
Hermite normal form ([7]) . Then 

(1) 5i = Sd+i-i if and only if D and d are coprime. 

(2) When D = kd, for fceN and k > 2, the 5-vector is 

(l, k, ■ -j , k , k — 1), 

d-i 

which is not shifted symmetric. But for k = 2, we have 5^ = S^-k ( Goren- 
stein). 
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4. Classification of Hermite normal forms with a given 5- vector 



In this section, we will give another application of the algorithm Theorem 12.11 
Consider Problem 11.21 first with the assumption that matrix A G Z dX(i has prime 
determinant, i.e., A is of the form (T4|), with only one general row. By Corollary 
13. 1| in order to classify all possible Hermite normal forms (jlj) with a given 5-vector 
(So, S\, ... , 5d), we need to find all nonnegative integer solutions (d\, d 2 , ■ ■ ■ , do-i) 
with d\ + d 2 + ■ ■ ■ + do-i < d — 1 such that 



#{z : d+ 1 -Si 



J. 



for i 



D} = Sj, for j = 0, 



d. 



, dj 



, »£)_i). 

d D -i) 



By Corollary 13. 11 we can build equations with "floor" expressions for (d\, d 2 , 
Remove the "floor" expressions, we obtain D linear equations of (di,d 2 ,. 
with different constant terms but the same Dx D coefficient matrix M with ij entry 
{(ij) mod D}, which is a number in {0, 1, . . . , D — 1}. Then we first get all integer 
solutions (d\, d 2 , ■ ■ ■ , rfo-i), and then test every candidates by the restrictions of 
nonnegativity and d\ + d 2 + ■ ■ • + do-i < d — 1. 

For D = 2 and 3, the coefficient matrix M is nonsingular, so we can write down 
the complete solutions, as presented in the first two subsections. For larger primes, 
the coefficient matrix becomes singular, so there are free variables in the integer 
solutions (di, d 2 , . . . , d^-i), which make it very hard to simplify the final solutions 
after the test. 

The idea is similar for Hermite normal forms with non prime determinant. Instead 
of using Corollary I3.1[ we need to use the formulas in Theorem 12.11 In the third 
subsection, we will present the complete solution for D = 4. 



4.1. A solution of Problem 11.21 when ^2 i=0 Si 
to give a solution of Problem 11.21 when Y2i=o $i = 



= 2. The goal of this subsection is 
2, i.e., given a 5-vector S(V) with 
Yli=o = 2? we classify all the integral simplices with S(V) arising from Hermite 
normal forms with determinant 2. 

We consider all Hermite normal forms flU) with D 



(\ 



A, 



2, namely, 
\ 



1 



V V 

where there are d\ l's among the *'s. Notice that the position of the row with a 2 
does not affect the 5-vector, so the only variable is d\. By Corollary 13.11 we have a 
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formula for the 5- vector of this integral simplex V(A2). Denote 



di 



Then one has 5q = 5k = 1. 

By this formula, we can characterize all Hermite normal forms with a given 5- 
vector. Let 5q = 5i = 1. Then by solving the equation i = 1 — Lh^Jj we obtain 
d\ = 2% — 2 and d\ = 2% — 1, both cases will give us the desired 5-vector. 

Notice that there is a constraint on d\ to be < d\ < d — 1. Not all 5- vectors 
are obtained by from simplices. But we can easily get the restriction of i and the 
corresponding d\ as follows (by d\ > 0, we have i > 1): 

(1) If i < d/2, c?! = 2z — 2 and c?i = 2i — 1 both work, and these give all the 
matrices with this 5-vector. 

(2) If i = (d+ l)/2, only d x = 2i - 2 = d - 1 works. 

(3) If i > (d+ l)/2, there is no solution. 

Now, this result has been obtained essentially in [J]. In fact, the inequality i < 
(d + l)/2 means that the 5-vector satisfies (J3]). 



4.2. A solution of Problem 11.21 when Y^=o ^ = 3- We consider all Hermite 



normal forms (HI) with D 



3, namely, 



(9) 



1 

* 3 



V 



1/ 



where there are c?i l's and c?2 2's among the *'s. Since the position of the row with a 
3 does not affect the 5- vector, so the only variables are d\ and di- Also, by Corollary 

1 + t kl +t k2 , where 



13.11 we have 5- 



V(A 3 ) 



(t) 



1 - dx - 2d 2 



and fco 



2 - 2di - d 2 



Then by the formula, similar to the case of X/<Lo^» = ^' though a little more 
complicated, we can characterize all Hermite normal forms with a given 5-vector. 
Let &v(A 3 )(t) = 1 + + t j . Set 



1 - di - 2d 2 



and j 
li 



2 - 2di - rf 2 



(Later reverse the role of i and j if i ^ j, in both equations and solutions.) After 
computations, the solutions for (d\,d 2 ) are 

[d 2 = 2i-j-l, [d 2 = 2i-j-l \d 2 = 2i-j-2. 

In addition, by the restriction on (di,d 2 ) that di,d 2 > and d\ + d 2 < cf — 1, we 
have the following characterizations: 

Table 1. Characterizations for matrices of the form (Q 



2j 


2% 


i + j 


solutions 


> i 


>j + l 


< d 


dW 


>i + l 


> J + l 


<d+l 


dW 


> i 


>j + 2 


<d+l 


d® 



(1) If 2j > i, 2i > j + 1 and i + j < d, then the solution d^ will work and this 
gives all the matrices with this 5-vector. 

(2) If 2j > i + 1, 2i > j + 1 and i + j < d+1, then the solution d^ will work 
and this gives all the matrices with this ^-vector. 

(3) If 2j > i, 2i > j + 2 and i + j < d + 1, then the solution d^ will work and 
this gives all the matrices with this 5-vector. 

(4) If {i, j} in the given vector does not satisfy any of the above cases, there is 
no matrix with this vector as its 5-vector. 

Again, this result has been obtained in [1]. In fact, for example, the inequality 
2j > i means that (T5]) holds and the inequality i + j < d + 1 means that ([3]) holds. 
Notice that only the solution 

d^ = 

works when i = (d + 2)/3 and j = (2d + l)/3. This happens when d = 1 (mod 3) 
and there is only one matrix with d\ = d — 1 and d 2 = 0. Similary, only the solution 

d^ = 





works when i = (2d + 2)/3 and j = (d + l)/3. This happens when d = 2 (mod 3) 
and again, there is only one matrix with d± = and d 2 = d — 1. 

4.3. A solution of Problem 11.21 when Ylt=o ^ = 4* When the determinant is 4, 
there are two cases of Hermite normal forms. One is the Hermite normal forms (jl]) 
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with D = 4, namely, 



A 



(10) 



Aa 



\ 



1 

* 4 



V V 

where there are d% l's, g?2 2's and c?3 3's among *'s. The other one looks like 



/l 



\ 



(11) 



A' 



1 

* 2 



1 

* 2 



V '•/ 

where there are d\ l's (resp. l's) among *'s (resp. *'s), there are e\ l's (resp. e[ 
l's) among *'s (resp. *'s) of which the entry of the row of * (resp. *) in the same 
column is 0. Also, set d" = e\ + e[. (For example, a 6 x 6 Hermite normal form 

(\ o\ 








V 1 





1 
1 











V 



is a matrix (fTTjl with d\ = 2, d[ — 3, e\ — 1, e[ = 2, d" = 3 and * = 1.) 

First, we consider the Hermite normal forms (flQj) . Then, by Corollary 13.11 we 
have 5 v( A 4 )(t) = 1 + t kl + t k2 + t hi , where 



1 — d\ — 2c?2 — 3g?3 
4 



1 - 



1 — d\ — C?3 



and k-x 



1 - 



3 — 3di — 2d 2 — d 3 
4 



Let 5-p{Ai)if) — 1 + f + P + t k . We get three sets of equations, according to the 



order of ki, k 2 and k 3 : 

l-dx-2d 2 - 3d 3 





1 — d\ — d 3 


,3 = 1- 


2 



and k 



3 — 3g?i — 2d 2 — d 3 
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(Later replace the roles of i,j and k if any of the three are distinct.) After compu- 
tations, the solutions for (<ii, d 2 , <i 3 ) are 



= -i+j + k-l 
<l l ' 1 = I <!-> = i-2] + k d (2) = 

= i + j - k - 1, 

d\ = — i + j + k 
d® = I d 2 = i - 2j + k and rf (4) 
ds=i + j — k — 1 



d\ = — i + j + k 
d 2 = i — 2j + k 
d 3 = i+ j- k-2, 

d\ = — i + j + k 
d 2 =i-2j + k- l 
d>3 — i + j — k — 1. 



In addition, by the restriction on (di, d 2 , ds) that d\, d 2 , d 3 > and ^1+^2+^3 < d—1, 
we have the following characterizations: 

Table 2. Characterizations for matrices of the form (flU!) 



j + k 


2j 


i+j 


solutions 


> i + 1 


<i + k <d+l 


>k + l 


dW 


> i 


< i + k < d+ 1 


>k + 2 


d® 


> % 


<i + k <d 


>k+l 


dW 


> i 


< i + k - 1 < d 


>k+l 


d^ 



(1) If j + k > i + 1, 2j < i + k < d + 1 and i + j > k + 1, then the solution 
will work and this gives all the matrices with this <5-vector. 

(2) If j + k > i, 2j < i + k < d + 1 and i + j > k + 2, then the solution d^ will 
work and this gives all the matrices with this 5-vector. 

(3) lij + k>i,2j<i + k<d and % + j > k + 1, then the solution d^ will work 
and this gives all the matrices with this 5-vector. 

(4) If j + k > i, 2j + 1 < % + k < d + 1 and % + j > k + 1, then the solution d (4) 
will work and this gives all the matrices with this 5-vector. 

(5) If {i, j, k} in the given vector does not satisfy any of the above cases, there 
is no matrix ([TO]) with this vector as its 5-vector. 

Notice that only the solution 

{d t = 
d 2 = 
ds = d — 1 

works when i = (3d + 3)/4, j = (d + l)/2 and k = (d + l)/4. This happens when 
d = 3 (mod 4) and there is only one matrix with d$ = d — 1. Similarly, only the 
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solution 




works when i = (d + 3) / 4, j = (d + l)/2 and = (3c? + l)/4. This happens when 
d = 1 (mod 4) and again, there is only one matrix with d\ = d — 1. 

Next, we consider the Hermite normal forms (TIT]) . However, we need to consider 
two cases, which are the cases where * = and * = 1. 

First, we consider the case with * = 0. Notice that the variables are dx, d[ and d". 
Obviously we cannot use Corollary 13.11 but we apply Theorem 12.11 directly. Thus 
we have S P ^(t) = 1 + t kl + t k2 + t k \ where 



d 1 + 2 



d[ + 2 



and k?, 



d'l + 3 



Let 5-pfM)(t) = 1 + f + P + t k . We get three sets of equations, according to the 



order of ki, k 2 and k 3 : 



d 1 + 2 



J 



d[ + 2 



and k 



d'( + 3 



or replace the role of i, j and k if i, j and k are distinct, in all equations and solutions. 
After computations, since d\ + d[ + d" is even, the solutions of (di, d[, d") are 



tZi = 2i - 2 

r/ i L ) = I d[ = 2] - 1 

d'l = 2k-3, 



d® 



di = 


= 2i - 


1 




d[ = 




2 




d'{ = 


-- 2k - 


3, 






' d x = 


2% - 


- 2 


■1 


d[ = 


2j 


- 2 




d'[ = 


2k 


- 2 



d x = 2% - 1 
( f M = I d' 2/ 1 and rf {4) 
d'l = 2k-2 

In addition, by the restriction on (d\, d[, d'l) that < d% < d — 2, < d' x < d — 2, 
0<d'l<d- 2, dx + d[ + d'l < 2(d - 2), d'l <dx + d[, d[ <dx+ d'l and dx < d[ + d'l, 
we have the following characterizations: 

(1) If i < [d/2\ , j < [(d - 1)/2J , 2 < k < [(d + 1)/2J , i + j + k < d + l,k < 
i + ji j + 2 < i + and z + 1 < j + fc, then the solution c^ 1 - 1 will work and 
this gives all the matrices with this 5-vector. 

(2) If i<[(d- 1)/2J , j < [d/2\ , 2 < k < [(d + 1)/2J ,i + j+ A:<d+l,A:< 
* + J ' + 1 — i + k and i + 2 < j + k, then the solution d^ will work and 
this gives all the matrices with this 5-vector. 
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Table 3. Characterizations for matrices of the form (TTTT) with * = 



i 


3 


k 


i + j 


i + k 


j + k 


i+ j + k 


solutions 


< 


d 

2 




< 


d-l 

2 




< 


2, 

d+l 
2 




> k 


> 3 + 2 


> i + 1 


< a + 1 




< 


d-l 
2 




< 


d 
2 




< 


2, 

d+l 
2 




> k 


> j + 1 


>i + 2 


< rf+ 1 




< 


d-l 
2 




< 


d-l 
2 




< 


d 
2 




> k 


> i + i 


>i + l 


< d 




< 


d 
2 




< 


d 
2 




< 


d 
2 




>k + l 


> j + i 


>i + l 


<d+l 





(3) If k < [rf/2j, z,j < [(d- 1)/2J, i + j + k<d,k<i + j,j + l<i + k and 
z + 1 < j + fc, then the solution <i( 3 ) will work and this gives all the matrices 
with this 5-vector. 

(4) If k < [d/2\, i + j + k < d + 1, k + 1 < i + jj + 1 < i + k and 
i + 1 < j + k, then the solution rf( 4 ) will work and this gives all the matrices 
with this 5-vector. 

(5) If {i, j, k} in the given vector does not satisfy any of the above cases, there 
is no matrix fllip . where * = 0, with this vector as its S- vector. 

Next, we consider the case with * = 1. By Theorem 12.11 we have 5-p^A' A ){t) = 
l + t kl +t k2 +t k \ where 



fci = 1 - 



l-d x - 2d'{ 



1 -d x 



and 



3 - d 1 - 2d[ 



Let 8v(A' A ){t) — 1 + t % + P ' + t k . We get three sets of equations, according to the 
order of fci, k 2 and k 3 : 



i = 1 



l-dx- 2d'{ 





1 - di 


,3 = 1- 


2 



and k = 2 



3 - g?i - 2d[ 
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or replace the roles of i,j and k if i,j and k are distinct. After computations, 
considering d\ + d[ + d'[ is even, the solutions of (di,d[, d") are 

1 

J -2 
J-l, 

2j-2 
2k- j -2 
2i- 3 -2. 

In addition, by the restriction on [d\, d[, d'() that < d\ < d — 2, < d[ < <i — 2, 
< < < d - 2, c?! + 4 + d'( < 2(d - 2), d'{ <d x + d! x , d' x <d x + d'{ and d x < d[ + d'{, 
we have the following characterizations: 



Table 4. Characterizations for matrices of the form ( fTTT) with * = 1 



2k 


2i 


2j 


i + j 


i + k 


j + A; 


solutions 


> j + 3, 

< G? + j + 1 


> j + 2, 
<^ + j 


< d- 1 


> k 


> 2j + 2, 
< d + 1 


> i + 1 




> j + 2, 

<G? + j 


> J + 1, 
<d+j-l 


<d-l 


> k 


>2j + l, 
< d 


> % + 1 


d( 2 ) 


> J + 3, 
< d + J + 1 


> J + 1, 
<d+j-l 


< d 


> k 


>2j + l. 
< d+ 1 


> i + 2 


d( 3 ) 


> j + 2, 


> J + 2, 
<c? + J 


< d 


>k + l 


> 2.7 + 1, 
< ci+ 1 


> i + 1 


d( 4 ) 



(1) If j + 3 <2k< d+j + lJ + 2 <2i< d+j,2j < d-1, 2j + 2 <i + k < d+1, 
i + 1 < j + k and k < i + j, then the solution d^ will work and this gives 
all the matrices with this 5-vector. 

(2) If j + 2 < 2k <d + j,j + 1 < 2% < d + j - l,2j < d- 1, 2j + 1 < i + k < d, 
i + 1 < j + k and k < i + j, then the solution d^ will work and this gives 
all the matrices with this 5-vector. 

(3) If j + 3 < 2k < d+j + 1, j + 1 < 2% < d+j-l,2j < d, 2j + l < i + k < d+1, 
i + 2 < j + k and k < i+ j then the solution d^ will work and this gives all 
the matrices with this <5-vector. 

(4) If j + 2 < 2k < d + j,j + 2 < 2% < d + j, 2j < d, 2j + 1 < % + k < d + 1, 
i + 1 < j + k and k + 1 < i + j then the solution d^ will work and this gives 
all the matrices with this 5-vector. 

(5) If {i, j, k} in the given vector does not satisfy any of the above cases, there 
is no matrix ( TlTT) with this vector as its 5-vector. 
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d^ 



d^ 



di = 23-1 
d[ = 2k - j - 3 
d» = 2i-j-2, 



di = 23-2 
d[ = 2k — j 
d'[ = 2i-3- 



3 
1 




Notice that only the solution 

{d x = d - 2 
d[ = d - 2 
d'i = 

works when i = (d + 2)/4, j = d/2 and fc = (3d + 2)/4. This happens when 
d = 2 (mod 4) and there is only one matrix with d± = d[ = d — 2. Similarly, only 
the solution 

{di = d - 2 
d'{ = d - 2 

works when i = 3d/4, j = d/2 and k = d/4 + 1. This happens when d = (mod 4) 
and again, there is only one matrix with d\ = d'{ = d — 2. 

5. The classification of the possible 5- vectors with Yh=o 5; = 4 

In this section, in consequence, we classify the possible 5- vectors with J2 i=0 Si = 4 
by results from Section [4731 

Let 1 + t n + t 12 + t 13 with 1 < %\ < %2 < «3 < d be a (^-polynomial for some integral 
polytope and (5o, 5i, • • • , Sd) a sequence of the coefficients of this polynomial, where 
it is clear that 5q = 1 and 5Tj i= . 5i = 4. Assume that (5o, S±, . . . , So) satisfies the 
inequalities ((2]), (jHJ) and <5i > 5^, which are necessary conditions to be a possible 5- 
vector. Then (j2J) and (EJ) lead into the following inequalities that (21,22,23) satisfies 

(12) i 3 < z'i + i 2 , i a + 23 < d + 1 and 2 2 < [(d + 1)/2J . 

Finally, the classification of possible 5-vectors of integral polytopes with Ylt=o $i = 
4 is given by the following 

Theorem 5.1. Let 1 + t 11 + t t2 + f 3 be a polynomial with 1 < i\ < %i < is < d. TTien 
t/iere exists an integral polytope V <Z M. d of dimension d whose 5-polynomial equals 
1 + t n + f 2 + f 3 2/ and on/y if (i%, z 2 , 23) satisfies (|12l) and an additional condition 

(13) 2z 2 < «i + 23 or 2 2 + «3 < d + 1. 
Moreover, all these polytopes can be chosen to be simplices. 

Proof. There are four cases: (1) %\ = 2 2 = 23, (2) %x < %% = 23, (3) i\ = 2 2 < 23, 
(4) 21 < 2 2 < 23. We will show that in each case ( 1121) together with ( fl3i) are the 
necessary and sufficient conditions for 1 + t n + t 12 + t i3 to be the S- vector of some 
integral polytope. 
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(1) Assume %\ = i 2 = i 3 = £■ By the inequalities ( fT2l) . we have 1 < £ < [(d+l)/2\ . 
Set i = j = k = £. We have 

(14) j + k > i + 1, 2j < i + k < d + 1 and i + j > k + 1. 

Thus, by our result on the classification of the case of a matrix fflQj) (Table 2, the so- 
lution S 1 '), there exists an integral simplex whose ^-vector is (1, 0, . . . , 0, 3, 0, . . . , 0). 

On the other hand, if there exists an integral polytope with this 6- vector, then (fl2l) 
holds since it is a necessary condition. In this case, it follows that both inequalities 
in (pED hold. 

(2) Assume £ = i x < i 2 = i 3 = £'. By flTJ), we have 1 < t < £' < [(d + 1)/2J . Let 
j = £ and i = k = £'. Then the inequalities (fl4l hold. Thus there exists an integral 
simplex whose 5-vector is (1, 0, . . . , 0, 1, 0, . . . , 0, 2, 0, . . . , 0). 

On the other hand, we have (fl2l) . Then, ?2+*3 < d+1 follows from i 2 < \_(d+l)/2\ . 

(3) Assume £ = i\ = i 2 < 13 = £'■ Set i = £' and j = k = £. Then it follows from 
(fT2l) that 

j + k > i,2j + 1 < i + k < d + 1 and i+j>k + l. 

Thus, by our result (Table 2, the solution d^), there exists an integral simplex 
whose 5-vector is (1, 0, . . . , 0, 2, 0, . . . , 0, 1, 0, . . . , 0). 

On the other hand, if there exists an integral polytope with this 5-vector, then 
(fT2l holds. In this case, it follows that both inequalities in ffl3|) hold. 

(4) Assume 1 < %\ < i 2 < i% < d. Suppose 2i 2 < i\ + i 3 holds. Set i = i 3 ,j = i 2 
and k = i\. Then we have j + k = %\ + i 2 > i% = i, 2j = 2i 2 <ii + i 3 = i + k< 
d+1 and i + j = i 2 + i 3 > 2i 2 + 1 > 2ii + 3 > i\ + 2 = k + 2. Thus, by our 
result (Table 2, the solution d^), there exists an integral simplex whose 5- vector is 
(1,0...,0,1,0,...,0,1,0,...,0,1,0,...,0). 

Suppose i 2 + i 3 < d+1 holds. Set % = i 3 ,j = i\ and k = i 2 . Then we have 
j + k = ii + i 2 > i 3 = i, 2j = 2ii < i 2 + i 3 = i + k < d + 1 and i + j = ii + i 3 > 
i\ + i 2 + 1 > i 2 + 2 = k + 2. Thus, by our result (Table 2, the solution d^), there 
exists an integral simplex whose 5- vector coincides with (60,61, ... ,64). 

On the other hand, assume the contrary of (|T3|) : both 2i 2 > i\ + i 3 and i 2 + i 3 > 
d + 1 hold. We claim that there exists no integral polytope V with this 5-vector. 
First we want to show that if there exists such a polytope, it must be a simplex. 
Note that the 6- vector satisfies ( TT2|) . Suppose i\ = 1. It then follows from ( TT2|) and 
i 2 + i 3 > d + 1 that i 2 = (d+ l)/2 and i 3 = (d + 3)/2. However, this contradicts (|3]). 
Therefore i\ > 1, and thus 61 = 0. By an explanation after equation ([1]), V must be 
a simplex. Now we can apply our characteristic results for simplices. 

If we set j = i 3 , then 2j = 2i 3 > i\ + i 2 = i + k. If we set j = i 2 , then 
2j = 2i 2 > ii + i 3 = i + k. If we set j = i\, then i + k = i 2 + i 3 > d + 1. In any 
case there does not exist an Hermite normal form ( TlOl) whose 6- vector coincides with 
(6 ,6i, . . .,6 d ). 
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Moreover, since i + j + k = i\ + i 2 + ^3 > i 2 + is > d + 1, there does not exist an 
Hermite normal form (iTTj) with * = whose S- vector coincides with (S , <5i, • • • , <5<i). 

In addition, if we set j = i%, then 2j = 2i^ > i\ + i 2 = i + fc. If we set j = i 2 , 
then 2j = 2i 2 > i\ + 23 = % + fc. If we set j = %i, then i + k = i 2 + i% > d + 1. 
Thus there does not exist an Hermite normal form (fTTj) with * = 1 whose 5- vector 
coincides with (5 , Si, . . . , Sj). □ 

Examples 5.2. (a) We consider the integer sequence (1,0,1,1,0,1,0). Then one 
has i\ = 2, i 2 = 3, i% = 5 and d = 6. Since (j2j) and ()3]) are satisfied and 2i 2 < h + i% 
holds, there is an integral polytope whose 5-vector coincides with (1,0,1,1,0,1,0) 
by Theorem 15.11 In fact, let M G Z 6x6 be the Hermite normal form (fTUl) with 
(di, d 2 , d 3 ) = (0, 1, 4) or (0, 0, 5). Then we have S{V(M)) = (1, 0, 1, 1, 0, 1, 0). 
(b) There is no integral polytope with its 5- vector (1, 0, 1, 0, 1, 1, 0, 0) since we have 
2i 2 > ii + is and i 2 + 13 > d + 1, although this integer sequence satisfies (El) and (111). 
(This example is described in pQ, Example 1.2] as a counterexample of [H Theorem 
0.1] for the case where Ylt=o ^ = 4-) However, there exists an integral polytope with 
its 5- vector (1, 0, 1, 0, 1, 1, 0, 0, 0) since i 2 + i% = d + 1 holds. 

Remark 5.3. From the above proof, we can see that when ^f=o ^* = ^> all the 
possible 5-vectors can be obtained by simplices. This is also true for all 5-vectors 
with ^2 i=Q Si < 3, from the proof of pQ, Theorem 0.1]. However, when Yli=o $i = 5> 
the 5-vector (1, 3, 1) cannot be obtained from any simplex, while it is a possible 
5-vector of a 2-dimensional integral polygon. In fact, suppose that (1, 3, 1) can be 
obtained from a simplex. Since min{z : Si 7^ 0, i > 0} = 1 and max{i : Si 7^ 0} = 2, 
one has min{z : Si 7^ 0, i > 0} = 3 — max{i : Si 7^ 0}, which implies that the 
assumption of [5, Theorem 2.3] is satisfied. Thus the 5-vector must be shifted 
symmetric, a contradiction. 
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